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ABSTRACT 



The conjugacy classes of nilpotent n x n matrices can be parametrised by partitions A of n, and for a 
nilpotent rj in the class parametrised by A, the variety J^fj of ry-stable flags has its irreducible components 
parametrised by the standard Young tableaux of shape A. We indicate how several algorithmic constructions 
defined for Young tableaux have significance in this context, thus extending Steinberg's result that the 
relative position of flags generically chosen in the irreducible components of JT^ parametrised by tableaux 
P and Q, is the permutation associated to {P,Q) under the Robinson-Schensted correspondence. Other 
constructions for which we give interpretations are Schtitzenberger's involution of the set of Young tableaux, 
jeu de taquin (leading also to an interpretation of Littlewood-Richardson coefficients), and the transpose 
Robinson-Schensted correspondence (defined using column insertion). In each case we use a doubly indexed 
family of partitions, defined in terms of the flag (or pair of flags) determined by a point chosen in the variety 
under consideration, and we show that for generic choices, the family satisfies combinatorial relations that 
make it correspond to an instance of the algorithmic operation being interpreted, as described in [vLee3]. 
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0. Introduction. 



The Schensted algorithm, which defines a bijective correspondence between permutations and pairs of 
(standard) Young tableaux, and the Schiitzenberger (or evacuation) algorithm, which defines a shape 
preserving involution of the set of Young tableaux, can both be described using doubly indexed families 
of partitions that satisfy certain local rules, as described in [vLee3]. In this paper we show how both 
correspondences occur in relation to questions concerning varieties of flags stabilised by a fixed nilpotent 
transformation rj. The mentioned doubly indexed families of partitions arise very naturally in this con- 
text, and they provide detailed information concerning the internal steps of the algorithms, rather than 
just about the correspondences defined by them. As a consequence, the study of the Schiitzenberger 
algorithm also leads to an interpretation of jeu de taquin, and of the Littlewood-Richardson coefficients. 
The connections between geometry and combinatorics presented here include and extend results due to 
Steinberg ([Stbl], [Stb2]) and Hesselink ([Hes]). 

The basic fact underlying these interpretations is that the irreducible components of the variety J-r; 
of ry-stable complete flags is parametrised in a natural way by the set of standard Young tableaux of 
shape equal to the Jordan type J(?/) of rj. In fact there are two dual parametrisations, and we show 
that the transition between them is given by the Schiitzenberger involution. Taking a projection on 
varieties of incomplete flags by forgetting the parts of flags below a certain dimension, we obtain from 
this an interpretation of jeu de taquin (operating on skew standard tableaux), and a bijection between 
Littlewood-Richardson tableaux and irreducible components of a variety of 77-stable subspaces of flxed 
type and cotype. 



The other interpretations involve the Robinson-Schensted algorithm and relative positions of flags. 
We give a derivation of Steinberg's result that the relative position of two generically chosen flags in given 
irreducible components of is the permutation related by the Robinson-Schensted correspondence to 
the pair of the tableaux parametrising those components. For this result a speciflc choice of parametri- 
sation is required, but there are variations of the statement for other choices; in particular when dual 
parametrisations are used for the two components, one obtains the transpose Robinson-Schensted corre- 
spondence, deflned using column insertion. Together, these interpretations give a geometric meaning to 
many key properties of the combinatorial correspondences: involutivity of the Schiitzenberger correspon- 
dence, confluence of jeu de taquin, the fact that the number of skew tableaux of a fixed shape and given 
rectification P depends only on the shape of P, symmetry of the Robinson-Schensted correspondence, and 
the various relations between this correspondence, its transpose, and the Schiitzenberger correspondence. 

This paper is organised as follows. In §1 we review the essential facts in the linear algebra of a vector 
space equipped with a nilpotent transformation rj, followed in §2 by the definition of the variety J^,,, and 
the parametrisations of its irreducible components by Young tableaux. In §3 and §4 we give the respec- 
tive interpretations of the Schiitzenberger algorithm, and of jeu de taquin and Littlewood-Richardson 
tableaux. In §5 we discuss relative positions of flags, which are used in §6 to give a geometric interpreta- 
tion of the Robinson-Schensted correspondence, and in §7 to give a similar but independent interpretation 
of the transposed Robinson-Schensted correspondence. 

In our combinatorial notation, as well as in our approach of the algorithms considered, we shall closely 
follow [vLee3]; we collect here the essential definitions used. A partition A is an infinite weakly decreasing 
sequence Aq > Ai > • • • of natural numbers (called the parts of A) with finite sum, denoted by |A|. To 
each partition A is associated its Young diagram Y{\) c N x N, defined by € 5^(A) <^=^ j < Xi 
(so that #F(A) = |A|); the transposed partition A* of A is the one whose Young diagram is obtained by 
reflection of Y{X) in the main diagonal. The elements of Y{X) are called its squares, and are depicted 
correspondingly (so that they may be filled with values); Young diagrams are displayed with the first 
index i increasing downwards, the second increasing towards the right, like matrices. The set of all 
partitions is denoted by V, and is partially ordered by inclusion of Young diagrams, written 'C'; the 
elements of Vn = {X gV \ |A| = n }, are called partitions of n. For the predecessor relation in V, that 
was denoted by e A~ in [vLeeS], we shall write instead fi -< X, with /U ^ A meaning that jj, ~< X or 
fi = X. When fi ^ X and Y{X) \ Y{i.i) = {x} we call the square x a corner of A and a cocorner of /i, and 
write X = iJ + x, fi = X — x and X — fi = x. We write x || y to indicate that squares x and y are adjacent. 

A Young tableau is an injective map T: Y{X) N, for some X gV called the shape shT of T, such 
that when each number T{i,j) is written as entry into square (/■', j), all rows and columns are increasing. 
Each such T determines a satiirated decreasing chain chT from A to (0) in by recording the successive 
shapes as the squares are removed from ^(A) in order of decreasing entries. When chT = chT' we write 
T ~ T', which is an equivalence relation on tableaux; for tableaux of fixed shape A, a set of representatives 
of the equivalence classes is formed by the set T\ of normalised tableaux, whose entries are all < |A|. 
For any non-empty Young tableau T, the square containing the highest entry of T is denoted by [T] , 
and the tableau obtained by removing that square (and its entry) from T by T~ . By applying the 
deflation procedure used in the deflnition of the Schiitzenberger algorithm to T, a tableau is obtained, 
in which the smallest entry has disappeared. The result of applying the full Schiitzenberger algorithm 
to T is denoted by S{T), and the pair of tableaux obtained by applying the Schensted algorithm to a 
permutation a is denoted by RS{a) (see [vLeeS] for deflnitions). 

When numbering or indexing with natural numbers, these definitions all start using 0, rather than 1; 
this holds in particular for the parts of a partition, and the rows and columns of Young diagrams. This 
leads to simpler expressions, but note that while row i of F(A) has length Ai, it has no square in column A,. 
We even have gone a bit further than in [vLeeS], by defining entries of normalised tableaux to start at 0. 
Also, the group S„ is taken to consist of permutations of {0, . . . , n — 1}, represented by sequences of the 
form (To, (Ji, . . . , On-i'i in particular, the order reversing permutation n e S„ satisfies hi = n — 1 — i. 

The work presented here was motivated by that of the author's thesis [vLeel] , which deals with the 
significantly more complicated case of other classical groups (in characteristic ^ 2) instead of GL„. There 
a combinatorial algorithm analogous to the Robinson-Schensted algorithm is deduced, that perfoms the 
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1 Nilpotent transformations 



corresponding computation of generic relative positions of flags: however there are complications that 
cause the descriptions and proofs to be much more technical than those in the current paper. Our 
aim here was to separate the main techniques and arguments of [vLeel] from a number of distracting 
technicalities, by applying them in the simpler situation of GL„; even so the reasoning is sometimes 
detailed and subtle. At the same time we believe that in describing that situation as transparently as 
possible, we have been able to provide some new insight. 

§1. Nilpotent transformations. 

Let be a vector space of finite dimension n over an infinite field k. In this section we recall some 
basic facts concerning V, equipped with a fixed nilpotent endomorphism ry. Most of these facts are also 
discussed, from a somewhat more general and elevated perspective, in [Macd, Chapter II]. 

A subspace V of V is called yy-stable if r]{V') C V' . There exists a decomposition of F as a direct 
sum of non-zero ?7-stable subspaces that cannot be so decomposed further; any summand of dimension d 
admits a basis xq, . . . ^Xd-i such that rj{xQ) = and ri{xi) = Xi-i for < i < d. This is called a 
decomposition into Jordan blocks; it is generally not unique, but the multiset of the dimensions of the 
blocks depends only on rj. Arranged into weakly decreasing order these dimensions form a partition of r?,, 
called the Jordan type J{r}) of ry. Throughout this paper we write A for J(ry) and u for the unipotent 
transformation + 1 e GL(y) corresponding to 77; when r] is variable, A and u are assumed to vary 
correspondingly. 

One can characterise A in terms of the powers rj^ of rj (among which we include = 1), without 
referring to any particular decomposition into Jordan blocks, as follows. 

1.1. Proposition. For all c > one has dim(ker7y^) = Xlo<j<c'^* ' which is the number of squares in 
the first c columns of the Young diagram Y{X). Similarly, dim(im7y^) = X]j>c^5' which is the number 
of squares in the remaining columns of F(A). 

Proof This is easily verified for individual Jordan blocks, from which the general case follows. □ 

For any ry-stable subspace V' of V, rj induces nilpotent endomorphisms of the; spac;cs V' and V/V, 
which will be denoted respectively by ri\v' and rj/yi. Since a nilpotent endomorphism of a 1-dimensional 
space is necessarily 0, a subspace I of dimension 1 (a line) is ry-stable if and only if I C kerr], and similarly 
a subspace H of codimension 1 (a hyperplane) is jj-stable if and only if H D imr]. 

1.2. Proposition. Let V be an rj-stable subspace ofV. Then J{r]\v') C A, and J{r]/v') C A. 

Proof The image of the subspace kevr]^ under the projection V V/V is kei t]^ / keT{r]\v')-' , for all 
j > 0; since kerrj-' C kerry-'+^, it follows that dim(kerr/-') — dim(ker(ry|y/)-') increases weakly as j increases: 

dim(kerry-') — dim(ker(77|y' )-') < dim(ker77-'^"'^) — dim(ker(r7|y' )-'^"'^). (1) 

The length A* of column j of YiX) is equal to dim(kerr/-'+^) — dim(ker77^) by proposition 1.1, so 
from (1) one gets J{ri\v')j < A^, and combining this for all j yields J{ri\v') ^ A. Similarly, the 
kernel of the projection imr]^ — > {imr]^)/V' = im(ry/i//)-' is equal to V fl imr]^ , so its dimension 
dim(im77^) — dim(im(ry/y/)-') decreases weakly as j increases, since imry^ D imry^"*"^. Then using 
A*- = dim(im77-') — dim(imr7-^+^), it follows analogously to the argument above that A*- > Jiri/v')) 
for all j, whence J{r]/v') C A. □ 

The partition J{r]\v') is called the type of V, and J{ri/v') is the cotype of V (in V). Since the 
spaces ker(?7|y/)^ = V D kert]^ whose dimensions determine the type of V are not directly related to 
the spaces V n im?7^ that were used to determine its cotype, it is not generally possible (for a fixed 
value of A) to determine the type from the cotype or vice versa. However, there is an exception when 
A is a "rectangular" partition, i.e., when all its non-zero parts have a fixed size d: in that case one has 
keiT]^ = imr]'^~^ for < j < d. This leads to the following fact. 

1.3. Proposition. If A = {d,d,...,d) with d occurring m times, and J{r}\v') = (mo, • • • 5Mm-i), then 
J{V/V') = {d- lJ.m-i,---,d- IJ.0). 
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1 Nilpotent transformations 

Proof. Prom the proof of proposition 1.2, one has for < j < d: 

J{r]\v')) = dim{V' n keTrf+^) - dim{V' D keirf) 

= dini(y' n imn''-^-') - dini(y' n imTj'^-^) = Xl_j_, - Jiv/v')d-j-i =m- J{v/v')d-j-i, 

from which the stated relation between J{r]\v') and J{ri/v') follows. □ 
Wc now specialise to the cases of r^-stablc hnes and hyperplanes. As we have seen above, r?-stabiUty 
of a lino / means I C kcrr^, so the set of r]-stablc hnes is identified with the projective space P(kcrr]), 
which we shall denote by P(y)^. Also, the cotype J{ri/i) of I is determined by the (weakly decreasing) 
sequence of values dim(Z n imrf) G {0, 1}, for j > 0. We define for j e N subspaces 

Wj {r]) = ker T? n im rf (2) 

of ker?7, which form a weakly decreasing chain. Wc also define subsets 

UM = 'PiWAri))\'Pm+,{v)) (3) 

of the projective space P(y)^; the non-empty Uj{ri) form a finite partition of that space. Wc have 
dimWj{r]) = A^- by proposition 1.1; therefore Uj{r]) is non-empty if and only if the following equivalent 
statements hold: A*- > A*_,_i; there is a corner of A in column j; at least one part of A equals j + 1. For 
the case of ?7-stablc hyperplanes we can apply these definitions to 77* , the nilpotent endomorphism of the 
dual vector space V* given by ri*{(f): v ^ (j){rj{v)) for (j) € V* and w e Wc therefore define 

W*{r]) = Wj{r]*) = { (/) G I (j,{imri) = A ^(ker 77^) = }. (4) 

The set Uj{rj*) is contained in the set P{V*) of 1-dimensional subspaces of V* , which is in canonical 
bijcction with the set of hyperplanes H oi V hy H 1-^ { cj) € V* \ 4){Ii) = }. Wc shall denote this set 
of hyperplanes by P*(l^), and its subset {H & P*(l/) | H D imr/} of ry-stable hyperplanes by P*(y)^. 
Then we define Uj{r]) as the subset of P*{V)r, corresponding to Uj{r}*): 

U*{ri) = {He P*{V)r, I H D kerrf AH^ ker?f+^ }. (5) 

The Uj{ri) and U*{r]) respectively partition P(y),, according to cotype and P*{V)rj according to type: 

1.4. Proposition. If I € Uj{T}), then the Young diagram of J{r]/i) is obtained from that of X by removing 
its corner in column j. If H € Uj{r]), then the Young diagram of J{r]\H) is obtained from that of A by- 
removing its corner in column j. 

Proof If I € Uj{ri), then by reasoning as in the proof of proposition 1.2 we find that A' — Jiv/v'Tj = 1) 
and Aji. = J{ri/v')c ^'^^ c ^ j. The argmncnt for H e U*{r]) is entirely analogous. □ 
For any basis {60, . . . , hk} of ker 77 with the property that each Wj [t]) is spanned by { &i | < i < A* }, 
one can find a decomposition into Jordan blocks V — Bq ® ■ ■ ■ ® Bk such that ker(?7|B. ) = {hi) for all i 
(it suffices to choose vectors v[ with ri^{v[) — hi, where {hi) € Uj{r]), and set Bi = {rf{v[) | < fc < j)). 
For any given / G 'P(y)r^ the basis can be chosen such that / = {hi) for some i; we shall call a corresponding 
decomposition of V into Jordan blocks adapted to I. We shall similarly call a decomposition of V into 
Jordan blocks adapted to H E P*(V)n if H contains all these blocks but one; for that block Bi one has 
H (iBi = im(?7|Bj- We see that the centraliser Zy, of u in GJj{V) acts transitively on each set Uj{ri) and 
on each Uj{r]). The following characterisations of the index j such that I G Uj{ri) respectively H G U*{ri) 
will be useful in the sequel. 

1.5. Lemma. 

(1) If I G Uj{rj), then j is the minimal value for which (kerry)/? D Wj{ri/i). 

(2) If H E U*{r]), then j is the minimal value for which hxirj C im(?7|fl') -|- ker(?y|//)'' . 

(3) H G Uj{r]) if and only if im 77 + ker 77^ = im(77|ij) + ker(77|if)^ . 

(4) IfHG Uj{ri), then Wc(77|ij) = Wc(77) for c^ j, while Wj{r]\H) is a hyperplane in ^^(77). 

Proof In each case let the initial condition be satisfied, and let V = Bq (B ■ ■ ■ (B Bk he a decomposition 
into Jordan blocks adapted to / respectively to H. For (1), let B^ be the block containing I, then 
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2 Flags 



V/l = i?o ffi • • • ® (Bi/l) (B ■ ■ ■ (B Bk, and the projection V ^ V/l is the identity on aU summands 
except Bi. This reduces us to the case V = Bf, then (kerr/)// = {0} and J{il/i) = (j), whence 
the statement is obvious. For (2), let Bi be the block not contained in H, then the intersection 
of imr] with any other block is contained in im{r]\H); this again reduces us to the case V = Bi, 
where the statement follows from J{ri\H) = {])■ Part (3) now follows because keryy'^ % H ior c > j. 
Part (4) also follows by considering the decomposition of V, or by observing that Wc{r]\H) C Wc{r]) 
and dim(Wc(r?)) = A*, in conjunction with proposition 1.4. □ 



A (complete) Bag / in V is a saturated chain = /o C /i C • • • C /„ = V of subspaces of V. We have 
dim/j = i, and the individual spaces fi are called the parts of /. Let be the set of all such flags, 
called the Hag manifold of V. It has the structure of a projective algebraic variety (see [Hum, 8.1]), and 
the maps f ^ fi are morphisms onto the respective Grassmann varieties. Of particular interest are the 
morphisms giving the line and hyperplane parts: if n > we define a:!F ^ P(^) ^^id dJijF — > P*(y) 
by oi{f) = /i, w(/) = /„_!. The group GL(y) acts on P(V), and 'P*{V), and clearly a and w 
are GL(F)-equivariant. We say that a flag f G is Tj-stable if all its parts are, and let denote the 
subvariety of Tj-stable flags in J^, or equivalently the fixed point set of u acting on J^; and cJr, will 
denote the restrictions to of a and oj, respectively. We have ima^ = P{V)r, = Uj>o^j(^)' ^^'^ 
similarly imw^ = P*{V)r, = Uj>o U*{r]). 

For each Tj-stable hyperplane H G P*{V)rj, the fibre u>~^{H) of iVrj is isomorphic to the variety T^^^ 
of ryljy-stable flags in H. Indeed the isomorphism is given by / hh. where = (/o C • • ■ C fn-i = H) 
is the flag obtained from / by omitting the last part /„ = V . Similarly, for each ry-stable line I G P(F)^, 
the fibre ot~^{l) is isomorphic to the variety J-rj/i of Ty/j-stable flags in V/l\ here the isomorphism will be 
written as f f^, where = {fi/l C • • • C /n/0 is the flag obtained from / by reducing modulo /i = I 
all its parts except /o. There will be no confusion if the same notations and are used when / is a 
flag in another vector space than V (provided its dimension is non-zero); this allows us in particular to 
write for f €: J-^ expressions such as/ , f^^^, and /~^, as long as the total number of operations applied 
does not exceed n. Moreover, the operations commute: and denote the same flag in fn-i/fi- 
In general, one obtains in this manner from / S an ?7j./^^. -stable flag in fi/ fj, for some i > j, where 
TJf^/f^ is the nilpotent endomorphism of fi/ fj induced by rj. 

The sequences of types and of cotypes of the parts of / € .F^ deflne two saturated decreasing chains 
in V from A to (0), that can be used to define Young tableaux rn{f), Qnif) € Tx: 



In other words, the subtableau olrn{f) containing entries < i has shape J{u\f^), while the subtableau of 
q-riif) containing entries < n — i has shape J{u/f.). If we define for each flag / G a dual flag /* in V* 
by /*i = { G I (/'(/n-i) = }, then one readily verifies that g^(/) = r^. (/*), and r^(/) = g^. (/*). 

As was mentioned earlier, there is in general no direct relationship between the type and cotype of 
the parts of /, and so there is no one-to-one correspondence between r^(/) and (?,,(/) cither. However, 
we have again an exception if A is a rectangular partition. To describe the relationship in this case, we 
introduce the involutive operation T i— > on 7^ for rectangular A: let the square t be the unique corner 
of A, then whenever some square s < t has entry i in t, then the diametrically opposite square t — s has 
entry nj = n — 1 — i in (this is essentially the same as the operation P i— > P of [vLee3, proposition 5.7]). 

2.1. Proposition. If A is a rectangular partition, then qr,{f) = rr,{fy for all f G J^rt- 

Proof Put chr^(/) = (A", A"-\ . . . , A°), and chg^(/) = (/x", . . . , /x"). Then each A' determines 
as described in proposition 1.3. For < i < n, the square with entry i in r^(/) is A*+^ — A*, 
which determines the square — containing hi in qrj{f); therefore Qnif) = Tn{fy ■ □ 



§2. Flags. 



chr,(/) = (J(r;), J(77|/„_ J, J(r/|/„_ J, • . . , (0)) 
chg^(/) = ( J(r,), J{rj,f,), J{rj/f,), (0)). 



(6) 
(7) 
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2 Flags 



We define for any Young tableau T of shape A: 

^v,T = {f€T^\r,{f)^T} (8) 

^;T = {/e^r, (9) 

If the square [T] hos in column j (which implies that Uj{ri) and U*{ri) are non-empty), then one has 
w(J^„,t) C U*{ri) and a{J^*j.) C Uj{r]). Moreover, for any H e J7*(r/) the fibre J^^^t r\uj-'^{H) is 
isomorphic to Tri\H,T- by / i— > /~, and for any I G Uj{r]) the fibre J^* j,r\a~^{l) is isomorphic to j,_ 
by / It follows by induction that each of the sets J^n,T and is non-empty, and open in its 

closure. As T ranges over 7^, the sets J^n,T partition into finitely many subsets, as do the sets J^^^t- 

2.2. Proposition. 

(1 ) For each T gTx the sets .F„,t and ^^^t irreducible. 

(2) dim(.7>,_T) = dim(.F* ,p) = n(A) =^ Z^i>o independently of T gTx. 



(3) The set of irreducible components of Tr^ is equal to { J^n,T \ T gTx}, and also to { J^^^t | T e 7a }. 

Proof. We proceed by induction on n = |A|, and only prove the statements for Tr),T, as those for T^^t 
are entirely similar (and also follow by transition to the dual vector space). The case n = is trivial, 
so assume n > 0; let T e 7^ and let [T] be the square Since U*{ri) is irreducible and an orbit 

for Zu, it is already an orbit for the identity component Z° of Z„ (in fact Z„ is always connected, 
but we do not wish to invoke that fact here). Using the isomorphism J^ri,T H uj~^{H) ^ ^ri\„,T- for 
some H e U*{vi), we may define a surjective morphism Z° x ^n\H,T- ~^ ^■n,T by {z,f~) ^ z ■ f; 
since the domain of this morphism is irreducible by the induction hypothesis, so is its image, which 
establishes (1). We have dim{Uj{r])) = dim{Wj{r])) — l = i, and so for any H e Uj{r]) we have dim.?>,,T = 
dimC/*(ry) + dim.F^|^_r- = i + n(shT-) = n(A), proving (2). Part (3) follows from (1) and (2). □ 

Remark. Part (3) gives two different natural parametrisations of the irreducible components of by 
Young tableaux. The first one, based on the types of the parts of flags (as it uses r^,) corresponds to 
the parametrisation used in [Stb2], but in [Spa2, II.5.3] the other parametrisation, based on cotypes (qn), 
is effectively used. We choose to work primarily with the former parametrisation, partly because it is 
somewhat simpler to use restrictions than quotients, but mainly because this choice leads to a more direct 
interpretation of the Robinson-Schensted algorithm. Note that our choice does lead to a slightly illogical 
use of asterisks: J^n,T has a fibration over Uj{r]), while .F* has one over Uj{r]). 

We close this section with an example, illustrating these parametrisations of the irreducible com- 
ponents of JF^ in the simplest non-trivial case, namely for the Jordan type A = (2,1). Then Tx has 
2 elements, namely 



T = 






1 


2 





and T' 






2 


1 





and hence J^ri has 2 irreducible components, of dimension n(A) = 1. To be specific, let us take 




Calling the standard basis vectors eo, ei, 62 we have kcrry = (^0,62) and imrj = (eo), while rj^ = 
for j > I. There are two Z„-orbits of ?7-stable hyperplanes, namely the set Uq{vi) of all hyperplanes 
containing imr; = (eo) but not ker?; = (eo, e2), and the singleton Ul{rj) = {(eo, 62)}. For any H G C/q (»7) 
the fibre oj~^{H) consists of a single flag /, with fi — H D kcrr/ = (eo) and of course /2 — H, so ^r],T 
is isomorphic to the affine line UQ{ri). On the other hand for H = (eo,e2) G Ul{ri) we have ri\H = 0, 
whence an vy-stable flag / with f2 = H can have an arbitrary element of P(-ff) as /i, so in this case the 
fibre w~^{H), which coincides with J^n,T', is a projective line. There is one element of J^n,T' that lies in 
the closure of J^n,T, namely the flag / with /i = (eo) and /2 = (eo, 62). Therefore, the whole variety J^ri 
can be depicted as follows 
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3 Interpretation of the Schiitzenberger algorithm 



This illustration should be considered to lie in Pi x Pi, with the horizontal coordinate representing the 
choice of the hyperplane H = f2, and the vertical coordinate representing the choice of the line /i . By 
similar reasoning to that above, it can be seen that the fibre ^^^t' the morphism is the horizontal line 
including the point of crossing, and J-'* .j^, is the remainder of the vertical line. So r,~i{ f) ^ Qriif) for all flags 
f G J-rj, except the flag represented by the crossing point of the lines, for which r^(/) = qr,{f ) =T' = 

§3. Interpretation of the Schiitzenberger algorithm. 

We shall now proceed to show that the two given paramctrisations of the irreducible components of J^^i 
are related by the involution S of Tx defined by the Schiitzenberger (evacuation) algorithm. In fact we 
shall give a more detailed description of the situation than this. We first recall the following two kinds 
of configurations of 4 partitions that can occur within the doubly indexed family of partitions that was 
used in [vLeeS, 2.2] to give a description of the Schiitzenberger algorithm. 

3.1. Definition An arrangement of 4 partitions with u ~< /j,, fj,' -< X is called 
(i) a conGguration of type SI if = 12' and (/U — u) || (A — /u), 

(a) a configuration of type S2 if /U ^ /u' (so that one has A = /x U /u' and y = fif\ ^'). 

Note that the condition (fj, — v) \\ (A — /x) implies n = n' (there are no other partitions between 
ly and A), and that in the other case the two partitions /i, /x' are the only ones between 1/ and A. It follows 
that if ( ^/ is known to be of type 5*1 or 5*2, then either one of /x or ^' is uniquely determined by 
the other three partitions. The relevance of these configurations becomes clear when one considers for 
v -< fj, -< X the following variety £n,n,v of partial flags, consisting of only a line and hyperplane part: 

£v,,^,. = { {I, H) e P(V), X ^*{V\ I J(77|h) = ^iAlCHA J{rjH/i) ^v). 

3.2. Lemma. Let v < [i < X, and let ji' he determined by the condition that { \ is of type SI or S2. 
Then Sri.fi.v is irreducible, and J{ri/i) = /i' for {l,H) in a Zu-stable dense open subset ofSrj^^^u- 

Proof Put X — iJ. = {i,j), ji — u = (r,c); then £n,fj.,i/ consists of those pairs {l,H) with H € U*{r]) and I G 
Uc{'n\H)-, from which its irreducibility follows. If j = c or i = r, then ^) is of type 51, and J{r]/i) = jJ,' 
is forced by ^ Jiv/i) ^ ^- If .7 7^ c and i r, then ( ^, ^) is of type S2; if moreover c ^ j — 1, then 
Ucivlii) = Uc{ri) follows from lemma 1.5 (4), so J{r]/i) ~ X—{r,c) = /i'. In the final case that c = j — 1 and 
r > i,we find for ah H e C/*(r?), again using lemma 1.5 (4), that Udrj) = P{Wc{ri))\P{Wj{r])) = Pr\Pi is 
dense and open in Uc{v\h) = P(Wc(r?))\P(Wj(r?|ij)) ^ Pr\Pi-i (with P_i = 0)), so the subset of f^,^,^ 
of pairs {l,H) for which I G Uc{r]) is dense and open, and on this set J{r]/i) = A — (r, c) = /x' holds. □ 

3.3. Theorem. There is a dense open subset T'^ of T^, such that for all / G .F^ the following holds: if 

for i+ j <n one puts A^*'-'! = JiVfn-j/fi)' then any conBguration 

is either of type SI or of type 52. 

Proof It will suffice to find for each T E T\ a. dense open subset of J^r^.T on which the stated 
condition holds. We use induction on n, with n = 1 as trivial starting case. Fix T E T\, and let 
the family (A[''-'l)i+j<„ of partitions be defined by chT = (A[°'°1, Al^'^l, . . . , A[°'"1), and by the condition 
on configurations in the statement of the theorem; we shall show that for appropriately chosen / G J^ri,T 
one has JivU-j/fi) — ^^^'''^ i + j < n. Choose some H G w{Tn,T), then by the induction hypothesis 
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applied to J^ri\H,T- ■, wo have for / in a dense open subset of the fibre ^r;,T H lu~^{H) that all instances 
of J{'nf^_- / f-) = AI*'-'] with j > hold. Since u>{J^ri,T) is equal to some Z'„-orbit U*{r]), this property 
extends by the action of Zy, to a Z„-stable dense open subset U of J^n,T- By construction U is contained in 
{ / e J^n,T I (/i, /n-i) € £r),ii,v }, which projects onto £r),ix,v with fibres that are all of dimension n{X^^'^^). 
It follows that U meets the inverse image under this projection of the dense open subset of described 
in lemma 3.2. The intersection W oiU with this inverse imago is a Z^-stable dense open subset of J^'q,T on 
which the additional property J{ri/j^) = AI^'^I holds. Then a{W) is a single Z„-orbit, and W intersects 
each fibre a.^^{l) for / 6 aiU') densely; the image of this intersection under / /•'' is a dense open 
subset of J^-mi,Ti-- The proof can now be completed by applying the induction hypothesis to T^^^^t^- CH 

3.4. Corollary. For allT gTx one has = J^* s{Ty 

Proof. This follows immediately from the theorem, and the fact the the family AI*'-'! with the mentioned 
properties can be used to compute S{T) (cf. the proof of [vLeeS, theorem 2.2.1]). □ 

The proof given for this geometric interpretation uses a description of S from which it obvious that 

5 is an involution (in fact one that was used to prove this fact combinatorially). However, even if we 
forget the proof, the interpretation clearly implies that S is an involution, since / £ J-* rp is equivalent to 
/* G J-ri',T, and /** = /. In combination with proposition 2.1, the corollary also implies that S(T) ^ 
for tableaux T of rectangular shape, as stated in [vLeeS, Corollary 5.7]; in this case the geometric proof 
has no purely combinatorial counterpart (the proof given in [vLeeS] is based on the relationship of the 
Schiitzenberger correspondence with the Robinson-Schcnstcd correspondence). There is on the other hand 
one combinatorially obvious symmetry of S without any clear geometric meaning, namely the fact that it 
commutes with transposition (a geometric interpretation of this fact would require some operation that 
gives rise to transposition of Jordan types). Nevertheless, this symmetry of S will be important below, 
when we give geometric interpretations of the Robinson-Schensted correspondence and its transpose. 

§4. Interpretation of jeu de taquin, and Littlewood-Richardson tableaux. 

The deflation procedure used in the Schiitzenberger algorithm is related to the operation of jeu de taquin 

(also known as glissement) , which is performed on skew tableaux. .leu de taquin can be described 
completely in terms of the deflation procedure [vLeeS, §5], which allows us to deduce from theorem 3.3 
an interpretation of jeu de taquin. That theorem does not mention tableaux or their entries directly 
however, but is stated in terms of families of partitions, and for our interpretation, all that matters about 
a skew tableau is the chain in V associated to it. For convenience we shall work directly with such chains, 
rather than with skew tableatix: we deflne a skew chain of shape X/n to be a saturated decreasing chain 
in V from A to /x. We denote the set of all skew chains of shape A//i by Ta/m! T\ is in bijection 

with 7a/0 by P chP. 

We proceed to give a geometric interpretation to skew chains, in analogy to the definition of J^r),T 
for Young tableaux T. Let Ql^ be the variety of m-dimensional //-stable subspaces of V, and let J^^"^^ 
be the set of ry-stable partial flags in V with parts in dimensions m and higher, i.e., of chains / = 
ifm C fm+1 G ■ • ■ C fn ~ V) with fi S ■ FoT f G JF^™^ the part of minimal dimension will be 
denoted by [/J, and we define the complete fiag / = (/m/L/J C • ■ • C /n/L/J) € -^rj/L/j by reducing all 
parts of / modulo [/J. We also define r^(/) = {J{v),J{v\fn-i)^ • • • > ■^('7Il/j)) ^ where /j. = J(r?|[/j), 
and put 

^,,if = {/e.F(") |r^(/) = i^}. 
4.1. Proposition. J^r),K is an irreducible variety of dimension n(A) — n(/u), for every K G Tx/zn- 

Proof. The proof is entirely analogous to that of parts (a) and (b) of proposition 2.2, the only diflference 
being that the induction starts at |A| = rather than at |A| =0. □ 

For a Young tableau T G 7a, let T<m denote its subtableau of entries less than m; putting /x = sh T^mi 
let r>TO G Tx/^ denote the subchain (shT, shT~, . . . , /x) of ch T corresponding to the remaining entries. If 
we denote by T^*'^ the result of applying the defiation procedure i times to T, then the relation > i^' of 
glissement {K' is obtainable from K by inward jeu de taquin slides) is defined in [vLee3, §5] by restricting 
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T and T^** to skew subtableaux with the same set of entries. The corresponding definition for skew chains 
is that r>„i T^**>m for i < m. We obtain from theorem 3.3: 

4.2. Corollary. Let K e Tx/f_i be a skew chain, and let P € % be a Young tableau such that K t> chP. 
Then there is a dense open subset J-^ ^ of J-.q,K such that r^f^yj^ (/) = P for all J ^ J-'^ . 

Proof Since K t> chP, there exists a T G "Ta with K = T>m and P ~ T^*"^. Let p denote the natural 
projection J^n,T — * ^ri,K (which is clearly surjective), and take x — p{^v,t ^ -^77)) where J^'^ is as 
in theorem 3.3; the conclusion of that theorem immediately implies '^j7/l/j(/) = P for f G .F^^^. □ 
In this geometric interpretation, confluence of jcu dc taquin is obvious: P is uniquely determined 
by K. We now partition t/JJ^ according to the type and cotype of its elements: for n G Vrm v G Vn-m put 

Gl. = {Xegi\ J{ri\x) = M A J{ri/x) = u); 
furthermore, denote by 7^'^^ the set of if G T^/^ such that K \> dnP for some P £%. 

4.3. Theorem. Denote by tt: T^"^^ — > the morphism given by f ^ [/J . Let jj, G Vm s^nd v G Vn-m- 

(1) If K G then the image 7r(jr^ ^) of the set T'^ ^ of corollary 4.2 is dense in an irreducible 
component of QJl^ of dimension n(A) — n(/x) — n(r^). Moreover, any such component is so obtained 
as -k{J-^^k) n Q^ ^, for at least one K G and there are no components of higher dimension. 

(2) The number of irreducible components of Q'^ ^j of dimension n(A) — n{fi) — n{y) is equal to the 
Littlewood-Richardson coefRcient c^^, and they can be explicitly parametrised by the Littlewood- 
Richardson tableaux of shape Xj \x and weight v. 

(3) For K,L £ ^/^i the irreducible components 7r(jF^,if ) fl G^ ,^ and 7r(jF^,L) fl QJl ,^ of Q^ ^, are equal if 
and only if K and L are dual equivalent in the sense of [Haim]. 

Limiting itself to what can be deduced from corollary 4.2, the theorem avoids any statement about 
possible irreducible components of of dimension less than n(A) — — n{iy). However, we shall 
show below that such components do not exist, and so an accordingly simplified and strengthened form 
of the theorem does in fact hold. 

Proof (1) It is clear that 7r~^(^Jf C {JpceTx/ -^v^k, whose components have dimension n(A) — n(/x), 
and the fibre 7r^^(X) at any X G C/JJ ,^ is isomorphic to J^rj/x^ whose components have dimension n(h'). 
Therefore any irreducible component C of QJ^ ,^ can have dimension at most n(A) — n(p) — n{v) , and when 
it has this dimension, 7r~^(C) is dense in some union of sets ^r],K with K G Tx/^. By corollary 4.2 one 
has 7r(jF'^ k) — ^Ji whenever K G from which the claims follow. 

(2) Corollary 4.2 also implies that Tjj.K meets any fibre tt^-^{X) with X G 7r(jF'^ ^) in the irreducible 
component of that fibre that corresponds to J-ri^^^p; hence, fixing an arbitrary P the irreducible 
components of Q'^ ,^ of dimension n(A) — n(/(i) — n{u) correspond bijectively to the skew chains K G T^y^ 
with K > chP. The number of such K is known to be independent of the choice of P ([Schii2, (3.7)]) and 
equal to c^ ^, ([Schii2, (4.7)], see also [vLee4, Theorem 5.2.5]). In fact there is a specific P G 7^, for which 
the Littlewood-Richardson tableaux T of shape \/n and weight u correspond directly to the skew chains 
K G "^/^ with K t> chP. To associate to a semistandard skew tableau T a skew chain K, one uses the 
well known process of standardisation: to form the chain K of partitions starting from A, the squares of T 
are removed by decreasing entries, and among squares with equal entries from right to left. Jeu de taquin 
is defined for semistandard tableaux in such a way that it commutes with this standardisation, and it 
preserves the property of being a Littlewood-Richardson tableau. The indicated special tableau P G 71/ is 
such that ch P is the standardisation of the tableau of shape v in which each row i filled with entries i 
(T^ is the unique Littlewood-Richardson tableau of shape v, and it has weight u). Then K G Tx/^ is the 
standardisation of a Littlewood-Richardson tableau T of weight v if and only if if > ch P. 

(3) Define for K,L E the equivalence relation if = L to mean TviJ-q.K) ^GJi ,y = ''^{J'-q.L) H Q"^ 
We have established above that for any P E% the jeu de taquin equivalence class { if G 7^'^^ | if > ch P } 
is a set of representatives for the classes for '='. As the members of such a jeu de taquin equivalence 
class are mutually dual inequivalent (this is the easy part of [Haim, theorem 2.13]), it will suffice to 
prove that K = L implies the dual equivalence of if and L. We shall establish this by finding a 
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sequence of jeu de taquin slides that transforms K and L respectively into K',L' G T^/ia, preserving 
equality of shapes at each step; being (chains of) Young tableaux of the same shape, K' and L' are 
dual equivalent [Haim, corollary 2.5], which implies dual equivalence of K and L. Since K = L, it is 
possible to choose partial flags / e ^^^k ^^'^ f ^ ^ri,L with [/J = [/'J ; by extending / and /' identically 
by suitably chosen parts in dimensions less than m, one obtains flags /, /' G JF'^ such that T = r,f{ f) 
and U = rrj{f') satisfy T>m = K, U>m = L, and T^m = U^m- Then for z < m the shapes of the 
skew chains T^*'^>rn and U^*'^>m are both equal to "^('7//.)/'^(^[/j//.) (since = //), which gives the 
required sequence of slides transforming K and L into K' = chT^^*"* respectively into L' = chU^*"^. □ 

The detailed statement of the theorem appears to be new. However, the relation between G^ ^, 
and Littlewood-Richardson coefflcients was already indicated in [Sprl, Theorem 4.4]. The setting there 
is in fact more general, with a semi-simple linear algebraic group G replacing GL„; correspondingly, 

is replaced by a variety X'^ b(-P) of parabolic subgroups, and Littlewood-Richardson coeflicients by 
decomposition multiplicities for representations induced from the Weyl group W of a Levi factor of P to 
the Weyl group W of G. (Our theorem corresponds only to maximal parabolic P, but can be extended 
easily so as to correspond to arbitrary parabolic subgroups.) The number of irreducible components 
of G^ j^ of dimension n(A) — n(/i) — n{iy) appears in a somewhat disguised form, as a decomposition 
multiplicity nA.B,(t>,ii for a permutation action of a group Cg{A) x Cg{B) on the set of irreducible 
components of A'j^ g{P) of that dimension; for GL„, the group Gg{A) x Cg{B) is always trivial, and 
'nA,B,<f,,ip reduces to the number of components acted (trivially) upon. 

Another, rather weaker, connection between the Littlewood-Richardson rule and the geometry of .7-"^ 
was indicated in [Sri]. Its main theorem (4.2) corresponds to our corollary 4.2, but it is stated (and 
proved) in a somewhat roundabout fashion in terms of permutations, whose link to geometry is formed 
by Steinberg's interpretation of the Robinson-Schensted correspondence (which will be discussed below). 
In fact, that theorem itself involves no geometry at all, and it can be proved in a purely combinatorial 
manner. Since only a flxed maximal parabolic subgroup P is considered, no connection with the geometry 
of G^^i, is indicated; the Littlewood-Richardson coefficients, which arise in relation to jeu de taquin in the 
same way as above, are only given their traditional representation theoretic interpretation. 

As we have seen, dual equivalence classes in T^y^ are in bijection with Littlewood-Richardson 
tableaux of shape A//z and weight v. Once the latter have all been determined, one can construct 
the set {K e. T^y^ | > ch P } effectively, not just for the special tableau P indicated in the proof above, 
but for any given P £ 7^. Such a construction is given in the proof of [vLec4, Theorem 5.2.5] in terms of 
the Robinson-Schensted correspondence for "pictures" ; we shall formulate it here without using pictures. 
One associates to any skew chain K £ T\i^ a, permutation w{K) by concatenating the rows of the skew 
tableau corresponding to K, taking them in order from bottom to top. Call the two Young tableaux 
{P,Q) — RS{w{K)) the P-symbol and Q-symbol of K; then the P-symbol of K characterises its jeu 
de taquin equivalence class (indeed i4' > chP), and the Q-symbol its dual equivalence class. Whenever 
J, > 0, all tableaux in % occur as P-symbol of some K e Tx/"^ , but not necessarily as Q-symbol. The 
set of tableaux that do so occur, is precisely the set Q{X/fi,iy) of Q-symbols of Littlewood-Richardson 
tableaux of shape A//x and weight (where the Q-symbol of a semistandard skew tableau is defined either 
as the Q-symbol of its standardisation, or directly by concatenating its rows and applying the version of 
the Schensted algorithm that allows repeated entries; either way the Q-symbol is a standard tableau). 
One then has 

{wiK)\K e^';AK>chP} = {RS-\P,Q)\QeQ{X/^,,y)}, 

from which the desired set of skew chains K is readily reconstructed. 

Now as promised we shall rule out the possibility that Q'^ ^, could have irreducible components of 
dimension less than n{\) — n{fj,) — n(i^), which implies in particular that G][ ^ = % whenever = 0. 
This requires an algebraic construction that associates a Littlewood-Richardson tableau to any individual 
element X G Q^^v- We essentially use the construction described in [Macd, II 3], but since our context is 
dual to the one considered there, we shall present an adapted version of the construction and proof. 

4.4. Proposition. For any \,iJb,v^ V , the irreducible components of G][ ^ are precisely those described 
in theorem 4.3, i.e., G^ ^, has no irreducible components of dimension less than n(A) — n(/u) — n(i^). 
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Proof. We shall construct for any X € ,y 'a tableau K G with X G n{!F,f_K)', then X lies in the 
component 'k{T^^k) H Q]^^^, and the proposition follows. Fix X G G^^„, and for i e N put Xi = r]~^{X) 
and /i* = J{ri\xi) (in particular jjP = jj, and /i'^" = A). By filling each skew diagram \ 
with entries i we obtain the transpose of a tableau T of shape A*//x* and weight (by proposition 1.2, 
since J{ri/x) = v); we claim that T is a Littlcwood- Richardson tableau (i.e., T [> Tj^t). Assuming this 
for the moment, the transposes K & T^/^ and P € 7^/0 of the standardisations of T and T,^t satisfy 
K > P (jeu de taquin commutes with transposition), so G -^//l- show that X e 7r(jF^_if ), it suffices 
to extend the sequence of subspaces Xq C Xi C • • • C X^„ by interpolation to some / G J-^ri,K- Now ry 
acts as on each of the quotient spaces X^+i/Xi, so any choice of complete flags in those spaces leads 
to a / G JF^™"*, which has moreover the property that all partitions /U* occur in the chain r^(/); we only 
need to show that it is possible to obtain r,,(/) = K. In fact, among the irreducible set of choices for /, 
a dense subset has r^{f) = K; this follows from the observation that for any subspace V 3 imr/, the 
projective space S = {H G P*(y)^ \ H DV'} meets U*{r]) whenever the vertical strip Y{X)\Y{J{r]\v')) 
meets column j, and then of course the intersection is dense in S for the minimal such j. 

It remains to show that T is a Littlewood-Richardson tableau. That T is a semistandard tableau 
means that each F(/i*+^) \ Y{fi^) is a vertical strip, or equivalently (/i*^^)* > (a**)* ^ (a**^^)c+i for 
i,c G N; this follows from the easily verified inclusions Wc{ri\xi+i) ^ M^c('7|xJ ^ W^c+i('7|xi+i )■ The 
remaining conditions for T to be a Littlewood-Richardson tableau can be formulated in several equivalent 
ways, but the following will be practical here, in view of proposition 1.1: denoting by T(i, c) the number 
of entries i in the first c rows of T, one has T{i + 1, c + 1) < T{i, c) for i, c G N (this implies T(i, c) = 
when i > c). Now T{i,c) is the difference between the number of squares in the first c columns of 
F(/i*+^) and of Y{n^); putting Xf = hss:{r}\xiY = H ker??^, we therefore have by proposition 1.1 
that T{i, c) = AiiaXf^^ - dimXf = A\jn{Xf^^/Xf). Now for all i, c one has 7?"^(Xf ) = X'r+l, whence r/ 
induces an injective map X^^^ I X'^^i giving the required inequality T{i+1, c+1) < T{i, c). □ 

§5. Relative positions of flags. 

Besides the use mentioned above of the Robinson-Schensted algorithm as a computational aid in dealing 
with classes of jeu de taquin equivalence and dual equivalence, there is also a direct geometric inter- 
pretation, due to Steinberg, of the correspondence defined by it. To formulate it, we need to attach a 
geometric meaning to permutations; it will be based on the fact that permutations of n parametrise the 
orbits for the diagonal action of GL„ on !F x J^. This parametrisation can be defined by associating 
to each pair (/, /') of flags a permutation called the relative position of / and /' that will characterise 
the GL„-orbit of (/,/')• By definition a G S„ is the relative position of / and /' if there exists a basis 
Co, ... , e„_i of V such that fi = (eo, . . . , ej_i) and = (eo-o , • ■ • , eo-i.i ) for all i < n. The fact that there 
always exists a unique such cr is the essence of Bruhat's lemma for GL„, but it is useful to give here an 
explicit demonstration of this fact. We shall use the auxiliary concept of a growth matrix. 

5.1. Definition. A growth matrix of order n is a matrix A = (Aj,j)o<i,j"<n with entries in N satisfying 

(i) Ai^o = Ao^i = and Ai^n = An,i = i for < i < n, 

(ii) A,+ij - A,j G {0, 1} and A.^+i - G {0, 1} for 0<i,j <n, 

(Hi) Ai+ij+i = Aij+i => Ai+ij = Aij (equivalently Ai+ij+i = Ai+ij => ^ij+i = Aij) for < i,j < n. 

A growth matrix A = (^i,j)o<ij<ri corresponds bijectively to a permutation a(A) G S„, whose 
permutation matrix IT (with Uij — 6i^cr{A)j for < i,j < n) is related to A by the equivalent relations 

Uij = Ai+ij+i - Ai+ij - Aij+i + Aij for <i,j <n, 
Aij = ^ ^ Ui'j' forO<i,j<n. 

0<i'<i 0<j'<j 

Define 7r(/, /') = a{A) where A is the growth matrix with Aij = dim(/i n /j). From the definition 
it follows that if a is the relative position of / and /', then 7r(/, /') = a; in particular a is unique. 
Conversely, for cr = 7r(/, /'), a basis eo, . . . ,e„_i witnessing the fact that a is the relative position of 
/ and /' can be constructed: for each i put j = a^^ (so that Ilj^j = 1) and choose for ej any vector in 
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the complement of the subspacc fi n /j within fi+i n f'jj^i (by the construction of a this subspacc is a 
hyperplane, and equal to both /j+i n /j and fi fl /j+i)- As an example, if / = /', then Aij = min(i, j), 
whence 7r(/, /') is the identity permutation; at the other extreme, when / and /' are in general position 
one has Ai^j = max(0, i + j — n), whence 7r(/, /') = n, the order reversing permutation. 
Remark. Besides the mentioned growth matrix A, growth matrices _B, C, and D can also be associated 
to (/, /') with B,^, = dim(/,/(/, n /;_^.)), C,^i = dim(/j/(/„_, n /j)), and A,, - dim(t//(/„_, + 
With a = <7{A) = 7r(/, /'), it can easily be verified that <7{B) = ah, cr(C) = ncr, and cr(-D) = hah. Since 
dim(V/(/„_i + f'n-j)) = dim(/* fl /j*), the last case implies that the relative position the dual flags is 
obtained by conjugation by n: 7r(/*, /'*) = n7r(/, f')h. It is also obvious that 7r(/', /) = 7r(/, f')~^. 
Remark. The Bruhat order '<' on S„ can be defined in terms the associated growth matrices: if cr = cr(^) 
and a = a{A'), then one has a < a' \i and only if Ai^j > A[j for all It follows that for any a G S„, 
the closure of { (/, /') | 7r(/, f) = a} in x T is { (/, /') | n{f, f) <a). 

§6. Interpretation of the Robinson-Schensted algorithm. 

In this section we shall demonstrate the result, due to Steinberg, that for a pair of fiags generically chosen 
in irreducible components of J^ri parametrised by a pair of standard Young tableaux, their relative position 
is related to those tableaux by the Robinson-Schensted correspondence. Like for the interpretation of 
the Schiitzenberger correspondence, this shall be deduced from a more detailed statement, that gives an 
interpretation of all the partitions in the doubly indexed family describing the algorithm; in the current 
case that family is the one of [vLeeS, 3.2]. We recall the basic configurations that can occur. 

6.1. Definition. An arrangement of 4 partitions ( '^z ^) is called 
(i) a conRguration of type RSI if v = ^ = ^' ^ \ and fiQ = Xq ~ 1, 

(a) a configuration of type RS2 if v ^ fi = fi' ^ \, with iii+i = Xi+i — 1 and Vi = Hi — 1 for some i > 0, 
(Hi) a configuration of type RS3 if u -< ^, i^' -< X and fi^ fi', 
(iv) a configuration of type RSO if v = ji < ^' = X or v = fi' < = X. 

6.2. Definition. A family of partitions (A'*'^1), wiere i and j each range over an interval ofZ, is said 
to be of type RS if any configuration ^jjii+i.j+'i] ) is of one of the types RSO RS3. 

Families of type RS were used in the proof of [vLeeS, theorem 3.2.1] to relate a permutation a 
and the pair (F, Q) = RS{a) of tableaux computed from it by the Robinson-Schensted algorithm. The 
pair {P, Q) describes the partitions at the boundary of the family, while a describes the places where a 

configuration of type RS\ occurs; specifying either of these suffices to determine the entire family. More 
precisely, to a family (A[*'''l)o<i,j<ra of type RS with A^"'"] = A, we associate tableaux P,Q e Tx such that 
chP = (A["'"1, A["-1'"1, . . . , A[°'"1) and chQ = (aI"'"!, AI"'""!!, . . . , A["'°1), and a permutation a = a(A) 
where A is the growth matrix with Aij = [AI*'-'! |, which means that i = aj if and only if {^fi+ij] ^^fi+ij+i] ) 
is of type RSI. (In its relation to P, Q, and a, our family has its indices interchanged with respect to 
[vLee3]; it remains of type RS, and it still establishes the relation (P, Q) = RS{a).) 

6.3. Theorem. Let P,Q & Tx, and cr G S„ with (P, Q) = RS{a). For all (/, /') in a dense open subset 
of J^n,p X ^ri,Q, the family J{'n\finf^)o<i,j<n Is of type RS, and in particular 7r(/, /') = a. 

6.4. Lemma. Let n,^' -< X, and let v be determined by the condition that (^/ ^) is of one of 

the types RS1-RS3. For any Ho G P*(F)^ with J{ri\Ho) = m'j there is a dense open subset of 
{H € P*{V)n I J{v\h) = /'.} on which J{r]\HnH„) = v holds. 

Proof. li fi ^' the configuration is of type RS3, and it follows from proposition 1.2 that one 
always has J{ri\HnHo) = ^ = M n /ti'. Assume now that fi = fi', and let X — fj. = so that 

H ranges over the set U*{rf), which has dimension i. If i = the configuration is of type RSI and 
U*{r]) = {-ffojj so that for the unique choice H = Hq one has J{ri\Hr\Ho) = ^(^|ff) = IJ- = v- Finally, 
if z > 0, the configuration is of type ^5*2. We claim that intersection with Ho defines a surjective 
morphism Uj{r]) \ {Hq} — > Uj,{r]\Ho), where jj, — u = (i — the lemma then follows by taking 

for the dense open subset of Uj{r]) the intersection of U*{ri) with the inverse image of U*,{rj\H„). To 
prove the claim, observe that restriction to Hq defines a linear map Wj{ri) — *■ Wj{r]\Ho) = W*,{r]\Ho), 
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whose surjectivity follows from lemma 1.5(3), or from a dimensfon consideration. □ 

We note that in the final case each of the fibres of the map U*{ri) \ {Hq} U*,{ri\H„) meets U*{ri), 
whence the restriction of that map to U*{r]) \ {Hq} is still surjective. This means that in this case any 
partition obtained from /it by removing a corner in some column c > j' can arise as J(»?|_frnJ?o) some 
non-generic H G U*{ri); of course, by taking H = Hq one can obtain J{r]\HnHo) = M as well. 

The lemma can also be formulated as follows: with \ — = and ^i' — u = one has for 

H in a dense subset of U*{r]) that H Ci Hq & U*,{ri\Ho)- It is not however true in general that as H 
traverses this subset of Uj{r]), the values H (1 Hq traverse a dense subset of Up{r]\Ho)- The reason for 
this is that within Hq equipped with r]\H„ the subspacc im rj is in no way special (it is not fixed under 
automorphisms), yet H Ci Hq always contains it (because both Hq and H do so). Although in some cases 
it can be shown that all hyperplanes in U*,{r]\Ho) contain im?7, there are also cases where this is not so. 
This circumstance makes the proof of theorem 6.3 more difficult than that of theorem 3.3. There are 
however no difficulties in extending the lemma as follows. 

6.5. Lemma. Fix an arbitrary Hag /' G and P e Tx; for all f in a dense open subset of J^r},Py the 

subfamily of J{ri\f.rif'.)o<i.j<n determined by j £ {n ~ l,n} is of type RS. 

Clearly only the hyperplane part H = fn-i of /' is relevant here. The sequence of subspaces fillH 
forms a complete jjlij-stable flag in H, except that one part is repeated. Denoting this flag (without 
the repetition) by f H H, the lemma states that for generic / € ^r],p one has f Ci H £ ^■q\H.P' 
fiCi H = /j+i n H, where P' and i are found by applying Schensted extraction (reverse insertion) to P, 
starting at the square A — J{ri\H) (recall that the entries of P start at 0). 

Proof We apply induction on n. Put (A", . . . , A°) = chP (so that A' = J(»7|/i)), and /it' = J{v\finH)- 
Applying lemma 6.4 with /i' = fi = A"^^, and Hq — H, we get for /„_i in a dense open subset lA 
of oj(T,j,p) that (^^^' ) is of one of the types i?51-i?53. If it is of type RSI, then /„_i = H for all 
/ G J--q,p, so that fjL^ = A* for i < n, and the remaining configurations {Jt+i (0 < i < n — 1) are 

of type RSO. Otherwise we fix any K €U and consider the fibre lj~^{K); the remaining configurations 
are then taken care of by induction applied to tjIk and K Ci H in place of rj and H, respectively. □ 
This lemma does not suffice as an induction step for the proof of theorem 6.3. The induction 
hypothesis will describe the generic relative position of the pair formed by a flag in J-rj\„^p' and /'~, but 
for reasons indicated above, the set of flags / D if is not generally dense in J^^^^ pi, and it is conceivable 
that the generic relative position of f H H and /'~ is different (smaller in the Bruhat order) . In order to 
dispell this possibility, we shall show that it is possible to write generic flags f £ T^\^^p> as / Hi? for some 
/ e Tfi,p, where fj is another nilpotent transformation of V than 77, but with J{r)) = A and fj\H = vIh- 
To that end, we shall now consider the reverse process of restricting a nilpotent transformation to a 
hyperplane. Let < io < n and define the following vector bundle over J^n,T- 

^„,T,io = { (/, v) e J^n,T xV\vGfi„}. 

Clearly ^n,T,io is stable under the diagonal Z„-action on J^rj,T x V. For any (/, v) G ^rj,T,io we define in the 
n+l-dimensional space y X a nilpotent transformation r) and a fiag /, as follows. Let e = (Oy,l) G Vxk, 
then fj is determined by fi\v = V and 77(e) — v, and / is defined by 

? r ,A if < i < in, 

I f^-l ©(e) if io < i - 1 < n. 

It follows from v G /,„ that / is 77-stablc. 

6.6. Lemma. Let T <E Tx and < iq < n. For all (/. ?;) in a dense open subset of !Fri,T,io: the associated 
fj and f satisfy the following property: with = J{f]\^) and A* = <^(^|/.ny) for Q < i < n + 1, any 
configuration of the form ( ^^+1 ^f+i ) is of type RSO if i <io, of type RSI if i = iq, and of type RS2 or RS3 
if i > io. 

Proof One has chT = (A"+i, . . . , A^^+i = A*" , . . . , A°), since f^ nV is ft if i < iq, and otherwise. 
Then the unique sequence of partitions for which the given conditions on configurations hold is readily 
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constructed; we shall take this as definition of , and show that J{fi\f.) = holds for < i < n + 1, 
provided (/, v) is chosen in an appropriate set. The statement for i < is immediate. For the remaining 
statements we shall apply induction on n (fixing io), starting at n = iq. Put v = u^^^ and let v—X = (r, c); 
then by lemma 1.5 (2), the statement J{fi) = v means that c is the minimal value with v e im?7+ker 77'^. For 
n = ?'o one has J^n,T,io — ^n.T ^V, r = 0, and c = j/q, which is the least value for which im?7 + kerr7° = V 
(in fact kerry'' = ^)> so the subset of J^rj,T,io of pairs (/, v) for which J {7)) = 1/ is dense and open. 

As preparation for the induction step, note that from the statement of the lemma implies that the 
smallest subspace of V, necessarily Z„-stable, containing im?7 and all values v for generic (and hence 
for all) (/, w) G ^ri.T.ioj equals imrj + keirj'^. Now assume n > iq, and choose an arbitrary hyperplane 
H G uj{J^t^^t)- Defining cD:^r,,T,jo ~^ 'P*{V) by i2>{f,v) = co{f), it will suffice to show that the property 
in the lemma holds in a dense open subset of u)~^{H) = J^n\H,T-,io^ ^ '^^^ then use the action 
of Zu to extend this subset to one of J^n.T.ia ■ The induction hypothesis gives a dense open subset U 
of il>~^{H) on which J{fl\f.) = for < i < n; it remains to show that generically one also has 
J(?7) = u. If z/" 7^ A then this holds on all of U by proposition 1.2. Otherwise (\ '^^) is of type RS2; 
let z^" — A" = A — A" = (r — 1, c'). By the induction hypothesis, the smallest subspace of H containing 
{v I (/,f) <eU} is im(?7|ij) + ker(ry|^f . Moreover, since H G U*,{V) this is equal to imvy + kcrrj'^ by 
lemma 1.5(3), and since c = A^. is the largest part < c' of A, also to imr; + keir]'^. If c = one has 
J{fj) = 1/ on all of U; otherwise this holds on the open subset {{f,v)£l(\v^imri + kerjy'^"^ }, which 
is non-empty (since A^ = c implies dim(im?7 + keTr]'^~^) < dim(imry + ker ri'^)) and therefore dense. □ 

We have now collected all the ingredients necessary to proceed with an inductive proof of theorem 6.3. 
Proof of theorem 6.3. For n < 2 the theorem is obvious, so assume n > 2; we shall prove that for any 
choice of i? G uj{Tr),Q) the family •/('7|/in/')o<i,i<n is of type RS for {f,f') in a dense open subset of 
ifi{H) = J^n,p X {to~^{H) n J-,j,q)- Let P' and to be the result of applying Schensted extraction to P 
starting at square AI"'"! - A^"^"-!!, so that ch(P') = (A["^"-i1 , . . . , AI'^+I'""!! = A['°>"-i1, . . . , AIO-""!]). 
Lemma 6.5 provides a dense open subset U of ip{H) on which the configurations ( ;^[i,n-i] ) are all 

of the required types, which implies fCiHG^F^^^ pi. On the other hand the induction hypothesis provides 
a dense open subset U" of T^^j^ pi x J-n\H,Q- such that remaining configurations ('*'^[i_j'_i] '^y^\i'j\ ) are 
of the required types whenever (/ n H, f'^) G U" . (Here the family of partitions obtained for {P',Q^) 
has been enlarged by duplicating each A^*"'-'!, to account for the fact that figr\H = fi^+i fl H.) The set 
U = {{f, /') &U' \{fr\H, /'-) G U" } is open in ip{H), and it remains to show that ^ 0. 

The set U" and the dense open set of lemma 6.6, applied with ri\H for rj and P' for T, both project 
to a dense open subset of J-ri\H,P'^ and the intersection of these images is non-empty. For a choice 
of inverse images of any point in the intersection, one finds a nilpotent transformation fj of H x k 
with 7(57) = A and tjIh = Vh, and {f,f') G J^fi,p x ^fj,Q with 7(57!^.^^,) = AI''-'! for all There 
exists a linear isomorphism g: H x k ^ V for which .g o j) = 77 o g, and by the transitive action of 
on Lu{J-,ri,Q) one can achieve that moreover g{H) = H: then g{f,f') G hi. completing the proof. □ 

Remark. Note that in the final argument we do not assume that g fixes H pointwise; indeed, this may 
not be possible, since it would imply im?) = g{mifi) = im/y (the latter identity follows from gof) = r]og), 
but the whole point of the construction of fj was to avoid fixing im fj to any particular subspace of H. 

§7. Interpretation of the transposed Robinson-Schensted algorithm. 

In this section we deduce, in close analogy to the previous section, an interpretation of the version of the 
Robinson-Schensted algorithm that is defined using column insertion instead of row insertion, and hence 
yields transposes of the tableaux P and Q. We start with a statement that is dual to lemma 1.5 (4). 

7.1. Lemma. Let / G Uc{f]), and let l: {V/l)* V* be the map induced by the canonical projection 
V ^V/l. For j ^ c one has '-(W/ (/?/;)) = Wj{r]), while i'(W*(r//;)) has codimension 1 in W*{r]). 

Proof Clearly l is injective, and the image of imr? -|- kert]^ under the projection V ^ V/l is contained 
in imr//; -|- ker(r//;)-', whence L{Wj{r]/i)) C Wj{r]). The lemma follows by dimension consideration. □ 

7.2. Definition. For any arrangement of partitions ( ^ ) of type RSi (i = 0, . . . ,3), the corresponding 
arrangement of transposed partitions (J^t ^t) is called a configuration of type RS^i (the types RS^O and 
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RS^3 are identical to types RSO and RS3, respectively). If a family of partitions (AI*'-'!) is of type RS, 
then the family of transposed partitions is said to he of type RS^ . 

7.3. Lemma. Let fi,ij' -< X, and let v be determined by the condition that (^/ ^) is of one of 
the types RS^1-RS^3. Then for any I e P(V^)r; with J{r]/i) = n' , there is a dense open subset of 
{H & P*iV)n I J{v\h) = fi} on which J{r]H/{inH)) = v holds. 

Proof If the configuration is of type i?5'*3, the conclusion follows (without the need to restrict to a 
dense subset) by proposition 1.2. Otherwise /i = /i', and we put X — ii — {r, c), so that H ranges over 
the set U*{r]) (of dimension r). By lemma 7.1, the subspace i-{W*{r]/i)) of W*{r]), has codimension 1; 
therefore, while H D kerrj" for all H e U*{rf), there is a dense open subset lA on which H 2 '?~'^(0- 
If the configuration is of type RS^l (i.e., c = 0), one has I D H ~ {0} for H U, and therefore 
J{^H/(inH)) = jJL = V- Finally if c > 0, so that the configuration is of type RS^2, it follows from 
H 2 kevr] or / G im?7 that H D l; hr H € U one has H/l ^ ker(r;/i)'=, but H/l D ker(?7/i)'=~^ 
by application of lemma 7.1 for j = c — 1, whence H/l G U*_i{ri/i). Then J{r]H/i) differs from 
H = J{ri/i) by a square in column c — 1, and is therefore equal to j/. □ 
Note that the generic cases match those of Lemma 6.4, with all partitions transposed, but the non- 
generic cases do not. We know of no geometric explanation for the first fact, but the latter is no surprise, 
since transposition reverses the dominance ordering on Jordan types that describes orbit closures. 

7.4. Lemma. Let I e P(F)^. For all Bags f in a dense open subset of J-^j, the following holds: defining 
A* — J{ri\f-) and = JiVft/infi) for < i < n, any configuration of the form {^t+i ^i+i ) is of one of the 
types i?5*0-i?5"3. 

Proof. This follows from lemma 7.3 just like lemma 6.5 follows from 6.4. □ 
Similarly to the situation for the interpretation of the ordinary Robinson-Schensted correspondence, 

the sequence of spaces fi/{l f) fi) forms a complete 77/;-stablc flag in V/l with one part repeated. For 
generic / € 3-rj,T this flag lies in J^ri/i,T' and has part i repeated, where this time T' and i can be found 
by applying the Schensted column extraction procedure to T starting at square A — Jiij/i), but again the 
set of flags so obtained is not generally dense in the indicated set. Here too the difficulty can be resolved 
by a converse construction to (in this case) dividing out the line /. 

For < if) < n and define the following Z^-stable set (a vector bundle over J^ri,T)'- 

^r,,T,.* = { (/, <^) e .F^.T X V* I C ker }. 
To (/, (p) G ^rj,T,i* we associate in the n + 1-dimensional space V x k a. nilpotent transformation and a 
fiag /, as follows. For {v,x) G V x k put j?(w,x) = {ri{v), (f>{v)), and with I = {0} x k CV x k define 

? r .n if < i < fo, 

\ © / if io < « - 1 < n. 
Since C ker^, the flag / is 7?-stable. We identify (V x k)/l with V, so that fi/l = for i > io. 

7.5. Lemma. Let T G T\, and < io < n. For all {f,(j)) in a Zu-stable dense open subset of J^n,T,i^, 
the associated fj and f satisfy the following: with i/^ = Jivlf.) and A* = J{Vf^/(infi)) < i < n + 1, 
any configuration of the form Ji+i) is of type RS^O if i < io, of type RS^l if i = io, and of type 

RS^2 orRSS if i > ia- 

Proof The proof is analogous to that of lemma 6.6, with variations as noted below. Let the families 
I/' and A' be determined by the requirements on the configurations; put u = and u — X = (r, c). 
Since (kerry)/? kcrry H kcrc/i, the statement Jifj) = v means that c — min{ j | Wj{r]) C kert/)}, by 
lemma 1.5(1). In the starting case n = io of the induction this holds, as c = and (/, (^) € Trj,T,n' 
implies (j) = Q. For n > io and H G uj{T,j,t) there is a surjection (/,</)) i-^ {f~,4>\H) of the fibre 
u)~^{H) (with (D(/, (/)) — oj{f)) onto the variety J^ri\H,T- {riOt an isomorphism, as in the proof of 
lemma 6.6). The induction hypothesis provides dense open subset of J^rt\H,T- l^t U C uj^^^H) be its 
inverse image, and z/" — A" = (r',c'), then Wc'{r]\H) = ker(?7|ij) n Q^j^^^gj,^ ker(0|//). In the interesting 
case RS^2 one has i/" = A and c' = c + 1, whence Wc'{r]) strictly contains Wc'(?7|ij) by lemma 1.5 (4), 
and Wc'(ry) % ker^ for some (/, (j>) G U. Therefore {(/,</>) \ Wc'{rj) % ker^} is dense in U, and on 
this subset c = min{j | Wj(r?) Cker(^}, since Wc(ry) = Wc(7?|if) C ker(^ for all (/,^) G ib~^{H). □ 
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7.6. Theorem. Let P,Q £ Tx, and a G S„ with = RS{a). For all {f,f) in a dense open 

subset of Tn,p x J'^ q, the family Jivfi/ifin f .))o<i jXn is of type RS^, and in particular 7r(/, f')n = a. 

Proof. The proof is analogous to that of theorem 6.3, using lemmas 7.4 and 7.5 instead of 6.5 and 6.6. □ 
Note that using theorem 3.3, the equivalence of the descriptions of the generic value of 7r(/, /') given 
in theorems 6.3 and 7.6 follows from the purely combinatorial statement [vLee3, theorem 4.1.1]. We have 
preferred to give independent proofs of theorems 6.3 and 7.6, thereby giving a geometric explanation for 
the "witchcraft operating behind the scenes" (cf. [Kn2, p. 60]) of that combinatorial theorem. 
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